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Abstract. Let F be a finite field or a local field of any characteristic. If A is a finite 
dimensional associative nilpotent algebra over F, the set 1 + ^4 of all formal expressions 
of the form 1 + a;, where x € A, is a locally compact group with the topology induced by 
the standard one on F and the multiphcation {1 + x) ■ {1 + y) — 1 + {x + y + xy). We 
prove a result conjectured by E. Gutkin in 1973: every unitary irreducible representation 
of 1 + j4 can be obtained by unitary induction from a 1-dimensional unitary character 
of a subgroup of the form 1 + -B, where B C A is an F-subalgebra. In the case where F 
is local and nonarchimedean we also establish an analogous result for smooth irreducible 
representations of 1 + A over C and show that every such representation is admissible 
and carries an invariant Hermitian inner product. 



1. Introduction 

Let F be a self-dual field, that is, a finite field, or M, or C, or a finite extension of Qp, 
or a field ¥q{{t)) of formal Laurent series in one variable over a finite field. We equip F 
with the natural topology, making it a locally compact topological field (for a finite field, 
the topology is discrete). The term "self-dual" is explained by the following observation. 
Fix a nontrivial unitary character ip : (F, +) — y of the additive group of F. For 
each a & F, define ipai^) = ip{ax) for all x & F. Then the map a is a topological 

isomorphism between (F, +) and its Pontryagin dual. 

Let A be an associative F-algebra, which is not assumed to be unital. For each m > 1, 
write A™ for the subspace of A spanned by all elements of the form 0102 ■ ■ - am, where 
aj G A. We say that A is nilpotent if A^ = for some m > 1. In this case the set 1 + A 
of all formal expressions of the form 1 + x, where x G A, is a group under the operation 
{1 + x){l + y) = 1 + {x + y + xy). (For instance, if A"^ = 0, then 1 + A is identified with 
the additive group of A.) 

Now suppose that A is a finite dimensional associative nilpotent algebra over F. Then A 
inherits a natural topology from F, and 1 + A becomes a locally compact (Hausdorff) and 
second countable topological group. Moreover, it is unimodular. If B is an F-subalgebra 
of A, then 1 + B can be viewed as a closed subgroup of 1 + A. 



In this situation, E. Gutkin formulated in [pu73|| the following statement: 
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Theorem 1.1. Let : 1 + A — > U{'H) he a unitary irreducible representation. Then 
there exist an F-subalgehra B G A and a unitary character a : 1 + B — )• such that 
71 ^ u-lnd] 



]1+A 



a. 



In this statement, U{'H) denotes the group of unitary operators on a complex Hilbert 
space and m — Ind denotes the operation of unitary induction (see § |4.3.3|) . 

The original motivation behind Theorem |1.1| was the following application: 



Corollary 1.2. If F = ¥q is a finite field with q elements and A is a finite dimen- 
sional associative nilpotent algebra over ¥g, the dimension of every complex irreducible 
representation of the finite group 1 + A is a power of q. 



This result follows from Theorem |0|, because, in the situation of Corollary |1.2| , if 
B G A is a subalgebra, then the index of 1 + -B in 1 + A equals gdim(yi)-dim(B)^ which is a 
power of q. 

As an example, fix an integer n >2 and let A be the algebra of strictly upper-triangular 
matrices of size n over ¥q (under the usual operations of matrix addition and matrix 
multiplication). Then 1 + A can be identified with the group f/L„(Fg) of unipotent upper- 
triangular matrices of size n over ¥q. In 1960 G. Higman asked whether the dimension 
of every (complex) irreducible representation of ULn(¥g) is a power of q (thus Corollary 
|1.2| yields an affirmative answer). Later this question was advertised and popularized by 
J. Thompson and A. A. Kirillov, among others, and eventually it led Gutkin to introduce 



the more general groups of the form 1 + A and formulate the more precise Theorem |Ll 



in [|Gu73| 



To the best of our knowledge, the first complete proof of Corollary |L2| was given by 
I.M. Isaacs |[lsa95|| in 1995, whereas the first complete proof of Theorem |1]T] when F is a 
finite field was given by Z. Halasi | Hal04 ] in 2004. Unfortunately, Halasi's proof relies on 
the result of | [lsa95|| ; in particular, it uses a counting argument, and it is not clear how to 
adapt this argument to the case where F is a local field. 

When F is a local field of characteristic (that is, M or C or a finite extension of Qp), 
one can prove Theorem |1.1| using the orbit method for unipotent groups over M ||Ki62|| or 
over Qp ||Mo65||. We briefiy explain the idea of this approach in §2.2|. 



The first goal of this article is to give a proof of Theorem for an arbitrary self-dual 
field F, in a way that is independent of the characteristic of F (see § |5.5| and Remark p.3[ ). 
An important ingredient in the proof is a certain result on commutators in groups of the 
form 1 + A that was first proved in | |Hal04| | . We review it in § P^ . 

One can also formulate Gutkin's conjecture in a different setting. Namely, suppose that 
F is a nonarchimedean local field. Then the topological group 1+A is totally disconnected: 
there exists a basis of neighborhoods of the identity element of 1 + A consisting of compact 
open subgroups. Thus it is natural to study smooth complex representations of 1 + A. 
Our second goal is to prove the following result: 
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Theorem 1.3. Let F be a nonarchimedean local field, and /et vr : 1 + A — )■ GL{y) he a 
smooth irreducible representation. Then vr is admissible and unitarizahle. Moreover, there 
exist an F-subalgebra B G A and a smooth homomorphism a : 1 + B — > such that 



IT 



lnd\'^^a and the natural map c— Indj; 



l+A 



+B 



a 



Ind]^"^ a is an isomorphism. 



In this statement, GL{V) denotes the group of aU hnear automorphisms of a vector 
space V over C, and Ind and c— Ind denote the operations of smooth induction and smooth 
induction with compact supports, respectively. AU the terminology and notation used in 
Theorem is reviewed in Section |[ The theorem itself is proved in §^]4, 



It is natural to ask whether, if G is any unipotent algebraic group over a nonarchimedean 
local field F, then every smooth complex irreducible representation of G(F) is admissible 
and unitarizable. At present an affirmative answer is known when char F = thanks to 
Ro76|, |vD78|| . The case char F > is open. 



All the main ideas of our approach to Theorems |1.1| and ^]3] can already be explained 
in the case where F is a finite field; at the same time, in this setting one avoids various 
technical complications that arise in the study of infinite dimensional (smooth or unitary) 
representations. Thus, for clarity, we treat this case first in 



Section ^ is essentially independent of, and different in spirit from, the rest of the 
article. In it we apply the techniques developed by Halasi in |[Hal04|| to prove Corollary 



^ which is the key algebraic input in our proofs of Theorems 1.1 and 1.3 



In Section ^ we review the basics of p-adic representation theory and conclude by stating 
two theorems due to F. Rodier |[Ro76|| that are crucial for our arguments. Finally, the 
complete proofs of Theorems JT] and are presented in Section ^ 
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2. Some special cases of Gutkin's conjecture 



We begin this section by introducing some general notation. Then we proceed to explain 
how Theorem [1.1| can be proved, in the case where F is a local field of characteristic 0, 
using the classical orbit method due to Kirillov in the case where F is archimedean and to 
C.C. Moore in the case where F is nonarchimedean. Finally we sketch a proof of Theorem 



LT| in the case where F is finite. The proof is different from the ones that can be found in 
the literature ||Hal04||, and contains all of the new ideas that allow us to prove Theorems 



O and |1.3| in full generality. 
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2.1. Notation. Throughout this paper, (-, ■) denotes the group commutator and 
denotes the Lie algebra commutator. We enunciate this in §§ p.l.l| - p.l.2 . 



2.1.1. Let F be a group. If Si, S'2 C F are subsets, then {Si, S2) denotes the subgroup of 
F generated by all elements of the form ghg~^h~^ with g E Si and h G S'2. 

2.1.2. Let A be an associative (not necessarily unital) ring. If x,y G A, then [x,y] '= 
xy — yx. If Si, S'2 C A are subsets, then [Si,S2] denotes the additive subgroup of A 
generated by all elements of the form [x, y] with x G Si and y G S2. 

2.1.3. If A is an associative ring, the two-sided ideals A"^ C A for all m > 1 and the 
notion of what it means for A to be nilpotent are defined as in the Introduction. 

2.1.4. Let A be a nilpotent associative ring. The corresponding group 1 + A is defined 
as in the Introduction. If J C A is a subring, then 1 + / is naturally identified with a 
subgroup of 1 + A. If J is a two-sided ideal of A, then 1 + J is a normal subgroup of 1 + A 
(the converse is usually false), and the quotient group (1 + A)/(l + /) can be naturally 
identified with 1 + {A/I), where A/ 1 is the corresponding quotient ring. All these remarks 
are used implicitly in what follows. 

2.2. Local fields of characteristic 0. Let us first settle Gutkin's original conjecture 



(Theorem |1.1| ) in the case where the base field is M or C. We will use the classical orbit 



method due to Kirillov ||Ki62|| together with an observation that we originally learned 



from a work of C.A.M. Andre ||And98 



Let F be a local archimedean field, and let A be a finite dimensional associative nilpo- 
tent algebra over F. There is no loss of generality in assuming that F = M (if F = C we 
can view A as an algebra of dimension 2 ■ dime A over M) . We can view 1 + A as a nilpo- 
tent Lie group, and its Lie algebra can be naturally identified with A (where the latter is 
equipped with the commutator bracket [a, b] = ah — ha) by means of the exponential map: 

exp: A^l + A, xi — + ^ + + ^ + 

(here we use both the fact that M has characteristic and the assumption that A is 
nilpotent). 

In general, if G is a nilpotent Lie group, g is its Lie algebra, and / : g — > M is a linear 
map, a polarization of / is a Lie subalgebra f) C g that satisfies /([(), f)]) = and has the 



maximal possible dimension subject to this property. Kirillov proved in ||Ki62|| that every 
linear / : g — > M has a polarization f), and the corresponding induced representation 
u — lnd%Xf of G is irreducible. Here if C G is the subgroup corresponding to P) and 
Xf = exp(2/) is the unitary character of H defined by /. Moreover, Kirillov showed that 
every unitary irreducible representation of G is unitarily equivalent to u — lnd'^Xf foi' 
suitable / and i). 
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In view of these results, we see that Theorem IlTI for F 



follows from 



Lemma 2.1. Let A he a finite dimensional associative nilpotent algebra over a field t, 
and let f : A — y t be a linear functional. Then there exists an [associative) t-subalgebra 
B G A such that, as a Lie suhalgebra of A with respect to the commutator bracket, B is 
a polarization of f . 



For the proof, see ||And98|] or ||BD06| , Theorem D.13] 

Next let us consider Theorem 
before, we may assume that F - 
case F - 



1.1 in the case where F is a finite extension of 



As 



Qp, and then we only need to repeat the proof of the 
almost verbatim, replacing the reference to ||Ki62|| with a reference to |[Mo65|| , 
where the orbit method for nilpotent Lie groups over Qp was developed. 

Remark 2.2. We were somewhat sketchy in this treatment of Theorem |1.1| for local fields 
of characteristic because the argument we give in § ^.5| below is also valid in this setting, 
and provides a different approach that does not directly rely on the results of ||Ki62| , [Mo65|| . 
Of course, some of the ideas we use are still directly inspired by the works of G. Mackey, 
as well as Kirillov, Moore and the other pioneers of the orbit method for nilpotent groups. 

2.3. Finite fields. Let us conclude the section by sketching a proof of Theorem |1.1| in 
the case where F is a finite field. We will be brief, because Section ^ below presents a 
self-contained proof of Theorems |1.1| and |1.3| that is valid both for finite fields and for local 
nonarchimedean fields. On the other hand, the argument we sketch here already contains 
all of the important ideas behind the proofs of Theorems |1.1| and |1.3| in full generality. 
Therefore we would like to present these ideas in an elementary context before reviewing 
the technical machinery of Section ^ 

The proof is based on the following crucial result. 

Corollary 2.3. Let t be an arbitrary field, and let A be an associative nilpotent algebra 
over t. Fix an integer m > 2, let ( : 1 + A™ — > be a homomorphism that is invariant 
under the conjugation action of 1 + A on 1 + A^, and define 

C^:{l + A)x{l + A""-^) 

by Cc_{g, h) = C{ghg-^h-^). Then 

(a) factors through a map 

C^: {1 + (A/A^)) X (1 + (A"-VA™)) C^; 

and 

{b) the map is t-bilinear in the following sense: 

• Cq{1 + xi + X2, 1 + = C(^{1 + xi,l + y)- Ci^{l + X2,l + y) for all xi, G A/A^ 
and all y E A^^V^™; 

• (1 + x, 1 + + 1/2) = C(;{1 + X, 1 + yi) • Q(l + X, 1 + 1/2) for all x G A/A"^ and 
all y^y^ G A^-i/A'"; 
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• C^{1 + Xx,l + y) = + x,l + Xy) for all X e t, x e A/A^, y e A"'~^/A"'. 

This corollary follows immediately from Proposition |3.1| belowQ, which is proved in 
Section ^ (the proof we give there is independent of any of the other results of this 
article). 

Now let F be a finite field, let A be a finite dimensional associative nilpotent F-algebra, 
and let vr : 1 + A — > GL{V) be an irreducible representation of the finite group 1 + A, 
where ^ is a finite dimensional vector space over C. Since A is nilpotent, there exists a 
smallest integer m > 1 with the property that tt{1 + A"^) consists of scalar operators. We 
may assume that m > 2, since otherwise vr is already 1-dimensional and there is nothing 
to prove. 

We obtain a homomorphism ^ : 1 + A"^ — > such that tcIq) = C{g) ■ idy for all 
g E 1 + v4™. The construction of ( implies that it is invariant under the conjugation 
action of 1 + A. Hence Corollary |2.3| can be applied. Let be defined as in that 
corollary and note that is not identically 1, since otherwise the minimality of m would 
be contradicted. 



Since I + IA/A^) and 1 + {A^ ^/A^) are naturally identified with the additive groups of 

C 

A/A^ {A'^-^/A"")* = Hom(A'^-V^",C^). 



A/A"^ and A"^ ^/A"^, respectively, we can view as a homomorphism of abelian groups 



Since F is finite and dimp{A'^~^ / A"^) < oo, we can further identify {A"^~^ / A^)* with the 
additive group of the F-vector space dual of A^'^/A^. With these identifications, the 
content of Corollary |2.3| (b) is that the homomorphism 

$^ -.A/A^^ (A^-V^"")* 
is actually a linear map of F -vector spaces. 

Since is not identically zero by construction, we can find a 1-dimensional F-vector 
subspace L C A^~^ /A^ such that the composition 

A/A^ (A"-V^")* L* 

is surjective, where the second map is given by restriction. Let Ai G A denote the 
preimage of the kernel of the above composition; then Ai is a codimension 1 two-sided 
ideal of A. Also, let U C A"^~^ denote the preimage of L; then f/ is a two-sided ideal of 
A. It is easy to see that ^|^_^^j^^_|_^^= 1; or, equivalently, that U C Ai. (See Lemma [STl 

for the proof.) 



^Observe that ( is invariant under (1 + A)-conjugation if and only if ^ is trivial on the commutator 
(1 + ^,1 + A™)- 
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Write G = l + A, H = l + Ai, N = l + U. Then N d H d G, a.nd both and H 
are normal subgroups of G. Let p be an irreducible summand of the restriction 7r|^. If 

we show that Ind^ p is irreducible, Frobenius reciprocity will imply that tt = Ind^ p and 
the proof will be complete^. 

To check that Ind^ p is irreducible, we apply Mackey's irreducibility criterion. Suppose 
g & G is such that g leaves the isomorphism class of p invariant. Since C, annihilates the 
commutator (iJ, A^) by construction, Schur's lemma implies that p acts on N via some 
scalar x • ^ — ^ We then necessarily have x|i_,_^m= and the definition of H 

implies that H is precisely the stabilizer of x under the conjugation action of G on A^. 
Since we assumed that g leaves the isomorphism class of p invariant, a fortiori, g must 
leave x invariant, whence g E H. This verifies the hypothesis of Mackey's irreducibility 
criterion (in the special case where one is inducing from a normal subgroup of a finite 
group), and the proof is complete. 

Remark 2.4. The proof sketched above has some ideas in common with the proof of 



Theorem |LT| that was presented in ||Hal04|| in the case where F is a finite field. However, 
that proof also contains some ingredients that seem to have no analogues in the case 
where F = ¥q{{t)). We were able to circumvent this difficulty by using Corollary p.3| . 

3. Commutators in groups of the form 1 + A 

This section is essentially independent of the rest of the article, in the sense that only 
the statement of Proposition below is used elsewhere in the text, and the proofs we 
present here rely exclusively on the results and techniques developed in ||Hal04] . 



3.1. The commutator pairing. The main goal of this section is the following 

Proposition 3.1. Lett be an arbitrary field, and let A be an associative nilpotent algebra 
over t. Fix an integer m > 2, put 

Q = {l + A^)/{1 + A,l + A'^), 

and define 

C:{l + A)x (l + A""-^) 
by letting C{g, h) be the image of ghg^^h^^ G 1 + A"^ in Q. Then 
(a) C factors through a map 

C:{1 + (A/A^)) X (1 + {A^-'/A"')) Q; 

and 

(6) the map G is t-bilinear in the following sense: 

• C{1 + xi + X2,l + y) = C{1 + xi,l + y) ■ C{1 + X2,l + y) for all xi,X2 G A/A^ 
and ally G ^"^"7^™; 



By induction on dinii? A, we may assume that Gutkin's conjecture holds for Ai in place of A. 
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• C(l + X, 1 + + 7/2) = C(l + X, 1 + yi) ■ C(l + X, 1 + 7/2) /or a; G Aj and 

all yi,y2 G A'^-^/A"'; 

• C(l + Ax, 1 + = C(l + X, 1 + \y) for all \ E t, x E A/A^, y E ^"-7^™. 
This result will be proved in § |3.3| below after reviewing some preliminaries. 



3.2. Free nilpotent algebras. Let R be an arbitrary associative, commutative, unital 
ring, let X be a set, and let n E N. If A is any nilpotent associative algebra over 
R, we call the nilpotence class of A the smallest integer k such that A^ = 0. The free 
associative nilpotent algebra of nilpotence class n generated by the set X over R is denoted 
by Fji{n,X) and is constructed as follows. First let spanj:j(X) denote the free i?-module 
generated by the set X, and let 



T = i?(X) = 0(span^(X))^ 



m>0 

be the free associative unital i?- algebra on the set X. It is naturally graded, and we will 
write 

= (span^(X))'^^ and T>m = ^Tj. 

j>m 

Writing J = F^{n,X) for simplicity, we define 

Thus J inherits a grading from T. It is clear that J satisfies a universal property with 
respect to all set maps from X to associative nilpotent algebras over R of nilpotence class 
< n. 

Proposition 3.2. Suppose that R is an integral domain whose field of fractions has 
characteristic 0. If J = F{i{n,X) for some set X and some integer n > 1, then for all 
k > 2, we have 

(1 + J, 1 + J) n (1 + J^^) = (1 + J, 1 + J''-^). 

Proof. When i? = Z this is [ Hal04| , Lem. 2.5]. In general one can check, line-by-line, that 
all the arguments in §2 of op. cit. remain valid if one replaces Z by an arbitrary integral 
domain R of characteristic and Q by the field of fractions of R. □ 

Theorem 3.3. If A is an arbitrary associative nilpotent ring, then for all m,n E N, we 
have 



1 + A"'A + A") C(l + A,l + A 



m+n— 1 ^ 



This is precisely Theorem 1.4 in op. cit. 
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3.3. Proof of Proposition |3.1| . We begin with 

Lemma 3.4. Let N be an associative ring, and letm>2 be an integer such that A^™-+^ = 
0. Ifx eN andy e N""'^ , then (1 + + ?/)(! + + 2/)"^ = 1 + [^^v] inl + N. 

Proof. We liave xyx = = yx"^ in A^. Using this observation, we calculate 

{1 + x){l + y){l + xy^ = 1 + {1 + x)y{l + xy^ 

= 1 + (1 + x)y{l — x) = l + y + xy — yx. 

Since m > 2, we also have xy"^ = yxy = 0. Thus 

{1 + y + xy — yx) ■ (1 + y)^^ = 1 + {xy — yx){l + y)^^ = 1 + xy — yx, 

as claimed. □ 



Now Proposition |3l|(a) follows from the fact that (1 + 1 + A""-^) C (1 + A, 1 + A 
which is a special case of Theorem |3.3|. 



Let us prove the first assertion of Proposition p.l| (b). For the purposes of this argument, 
let us introduce the notation h) = ghg~^h~^, where g, h are elements of some group. 
The first assertion of Proposition p.l| (b) amounts to the following claim: if Xi, X2 G A and 
y e A'""^ then 

(3.1) +xi + X2,l + y)- + xi, 1 + y)-^ ■ + X2, 1 + y)-^ e{l + A,l + A"'). 

To see this, let us write y = J2f=i '^i,j'^2,j ■ ■ ■ fl(m-i) j- for some elements a^j- G A, where 
is a positive integer, 1 < i < m — 1 and 1 < j < N. (We can find such a presentation by 
the definition of A"^'^.) Introduce a set X of formal symbols as follows: 

X = {xi,X2}u {aij}i<.<^_i^ i<^.<^. 

Let n be the nilpotence class of A and consider J = Frz{n, X), the free associative 
nilpotent algebra of nilpotence class n generated by the set X over Z (see 



Let (fi : J — > A be the homomorphism of associative rings that takes Xi ^ Xi {i = 1, 2) 
and takes a^j i-)- for all i,j. Then we have ip{y) = y, where 

N 

i=i 

Now consider the reduction of J modulo J^^^. Applying Lemma |3]^, we see that 
/3(1 + xi + X2, 1 + = 1 + [xi + X2, y\ mod J™+\ 

/3{l + xi,l + y) = l + [xi,y] mod 7""+^ and /3(1 + X2, 1 + y) = 1 + [x2, mod 7"*+^ 
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Since [xi + X2, y], [xi, y], [x2, j/] G J*", it follows that 

+ xi + X2, 1 + = + xi, 1 + ■ (3{l + X2,l+y) mod J™+\ 
or equivalently 

+ + ^2, 1 + ■ + xi, l + y)-^- + ^2, 1 + y)"' G 1 + 

Since the last expression belongs to (1 + J, 1 + J) by definition, we see that it in fact 
belongs to (1 + J, 1 + J) fl (1 + 7™+^). By virtue of Proposition ^]2|, the last intersection 
is equal to (1 + J, 1 + J*"); thus 

+ xi + X2,l + y)-l3{l + xi, l + y)-^- + xs, 1 + y)~^ G (1 + J, 1 + J"^). 

Applying the homomorphism (f : J — > A to the last containment yields (|3.1|). 



The proof of the second assertion of Proposition p.l| (b) is almost identical to the proof 
we just presented, so we will skip it. 

Finally, the proof of the third assertion is similar, but contains an additional idea. 
Again, the assertion amounts to the following statement: if x G A, ?/ G A"^~^ and A G 
then 

(3.2) + Xx,l + y)- + X, 1 + \y)-^ e{l + A,l + A™). 

To prove this containment, we begin, as before, by writing y = XljLi ^ij^^j ■ ■ ■ «(m-i)j- 
for suitable aij G A. Consider the set of formal symbols 



X = |x} U {ajj} 



l<i<m-l, l<jr<A^' 



and let R = Z[A] be the polynomial ring over Z in one variable A. There is a unique ring 
homomorphism R — y t such that A t— )■ A; by means of this homomorphism we can view 
and hence also A, as -R-algebras. 

Next let J = Frii{n,X) be the free associative nilpotent algebra of nilpotence class n 
generated by the set X over R (where n is the nilpotence class of A) and let <y9 : J — > A 
be the homomorphism of -R-algebras determined by (p{x) = x and <f{aij) = a^j for all i, j. 



From this point on the proof proceeds as before. Using Lemma |3.4| we deduce that 
/3(l + Ax,l + y) =/3(l + x,l + Ay) mod J™+\ 

which implies that 

/3(1 + AJ, 1 + ■ /3(1 + X, 1 + \y)-^ G (1 + J, 1 + J) n (1 + J^+i) = (1 + J, 1 + J'") 



where the last equality follows from Proposition p.2[ Applying ip to the last containment 
yields (|3^), which completes the proof of Proposition ^7\\ 
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4. Representations of totally disconnected groups 

This section is mostly a review of standard facts and definitions from the theory of 
smooth representations of locally compact totally disconnected topological groups. In 
§|4.7| we reproduce some important results of F. Rodier |[Ro76|| , which play a crucial role 



in Section |^ below. 

4.1. Representations of ^-groups. In this article we will follow the terminology of 
|BZ76|| . In particular, we make the following 

Definition 4.1. An i-group^ is a Hausdorff topological group G such that the unit element 
1 G G has a neighborhood basis consisting of compact open subgroups of G. 

A primary example of an £-group for us is the group G{F) of F-points of an algebraic 
group G over a local nonarchimedean field F. The topology on G{F) is induced by the 
usual topology on F. An £-group of the form G{F) is also second countable, which will 
be important for us. 

It is convenient to isolate a special class of ^-groups that plays an important role in 
|[Ro76|| (on which our work relies heavily), but for which no term was introduced in op. cit. 

Definition 4.2. An ic-gi^oup is an £-group G that is a filtered union of its compact open 
subgroups; in other words, every g E G is contained in a compact open subgroup of G, 
and any two such subgroups are together contained in a third such subgroup. 

For instance, if G is a unipotent algebraic group over a local nonarchimedean field F, 
then G{F) is an ic-group. In particular, groups of the form 1 + A, where A is a finite 
dimensional associative nilpotent algebra over F, are £c-groups. 

For convenience, we recall that a smootf^ representation of an i'-group G is a pair (vr, V) 
consisting of a complex vector space V and a homomorphism vr : G — > GL{V) with the 
property that for each v G V, the stabilizer G'" = \^g E G \ Tc{g)v = f } is open in G. By a 
standard abuse of notation we will sometimes denote a smooth representation (vr, V) by 
the single letter vr or V. 

A morphism between smooth representations of G is defined as a homomorphism of 
abstract representations, and the category of smooth representations of G will be denoted 
by n{G). 

A smooth representation (vr, V) of G is said to be: 

• irreducible if \^ 7^ and the only 7r(G)-invariant subspaces of V are and V; 

• admissible if for every compact open subgroup K G G the subspace 

= {veV\ 7T{g)v = v\/geK] 

is finite dimensional; 



"'Another common term is "l.c.t.d. group," which stands for "locally compact totally disconnected 
group." 



4. 



The adjective "algebraic" is used in |BZ76| in place of "smooth 
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unitarizable if V has a positive definite Hermitian inner product invariant under 
7r(G). 

By an argument of Jacquet (cf. | [BZ76| , 2.11]), Schur's lemma holds for second countable 



^-groups. More precisely, if (vr, V) is an irreducible smooth representation of a second 
countable £-group, then every linear operator V — > V that commutes with vr(G) is a 
scalar. 

In Theorem |1.1| we need to deal with unitary representations (which are typically not 
smooth) of topological groups. Let us recall that a unitary representation of a topological 
group G is a pair (vr,?^) consisting of a Hilbert space "H over C and a continuous homo- 
morphism vr : G — > UiTi), where U{'H) is the group of unitary linear automorphisms of 
"H equipped with the strong operator topology. In this case (vr, "H) is said to be irreducible 
if "H 7^ and the only closed subspaces of l-L invariant under vr(G) are and "H. 

4.2. The smooth dual. If (tt, V) is an abstract representation^ of an £-group G, the 
subset V'^^ C V consisting of vectors v & V for which the stabilizer C" is open is a 
G-subrepresentation of V , which by definition is smooth. In fact, the functor V \ — V^"^ 
from the category Rep(G) of abstract representations of G to the category TZiG) is right 
adjoint to the inclusion functor TiiG) Rep(G). 

If is a smooth representation of G, form the contragredient representation Homc(V", C) 
of G as an abstract group. The smooth part := Homc(V, C)**™ is called the smooth 
dual of V . We also writeQ tx^ : G — )■ GL{y^) for the corresponding homomorphism. 

The relation between the notion of admissibility and smooth duality is explained by 
the following standard (and easy) statement. 

Lemma 4.3. If tx is a smooth representation of an i-group G, then vr is admissible if 
and only if the canonical morphism vr — > {tx^Y '^^ ^'^ isomorphism. In particular, if 
TT is a smooth irreducible admissible representation of G, then vr^ is also irreducible and 
admissible. 

4.3. Induction functors. In this paper we use three induction functors for representa- 
tions of ^-groups. Let G be an £-group, and let if C G be a closed subgroup (in particular, 
H is also an £-group). 

4.3.1. Smooth induction. Suppose (p, IV) is a smooth representation of H . We can form 
the induced representation of p from G to if in the sense of abstract groups. By definition, 
its underlying vector space Vug consists of all functions / : G — )■ W that satisfy 

f{9h) = p{h)-f{g) \/geG, heH, 



^That is, TT : G — > GL(y) is a homomorphism of abstract groups. 

^The notation (tt, V) is used in [BZ76] in place of (tt^, V^), but we prefer not to use the tilde symbol 



to avoid confusion with its other common uses. 
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and the G action on Vug is given by left translation: 

{9-f){9') = f{9-'-9') V/GH.„ 9,9' eG. 

The representation V^^"^ of G will be denoted by Ind^ p or Ind^ W . Thus we obtain a 
functor 

Indg : n{H) — > n{G), 

called smooth induction. Frobenius reciprocity follows formally: Ind^ is right adjoint to 
the restriction functor TZ^G) — > 1Z{H). 



4.3.2. Compact induction. In the setting of § [4.3. 1| , the subspace of consisting of func- 



tions / G whose support is compact modulo H affords a smooth G-subrepresentation 
of Ind^ p, which we denote by c— Ind^ p. Thus we obtain a functor c— Ind^ : Tl{H) — > 
TZiG) together with a natural transformation c — Ind^ Ind^. One calls c — Ind^ the 
functor of induction with compact supports (or simply "compact induction"). 

We caution the reader that in ||Ro76|| , the notation Ind^ is used for the functor of 



induction with compact supports, while no notation for the smooth induction functor is 
introduced. 

Remark 4.4. Suppose G and H are unimodular ^-groups, which is the case in which we are 
mostly interested. (For example, if G and H are unipotent algebraic groups over a local 
field F, then G{F) and M.{F) are unimodular ^-groups.) Then there is a simple relationship 
between the functors c— Ind^ and Ind^. Namely, if p is any smooth representation of H, 
there is a natural isomorphism of G-representations between (c— Ind^ p)^ and Ind^(p^). 

A more general statement, where the unimodularity of G or is not assumed, is proved 
BZ76| , Proposition 2.25(c)]. 



m 



4.3.3. Unitary induction. Here we only consider the unimodular case, since it is simpler 
and it is the only one relevant for us. Let G be a unimodular £-group, and let if C G 
be a closed unimodular subgroup. Then the coset space G/H has a G-invariant measure, 
which is unique up to scaling. Fix one such measure p. 

Suppose p : H — > U{l-L) is a unitary representation of if, and let us denote the 
corresponding Hermitian inner product on "H by (■, ■). Given a measurable function / : 
G — 7- "H that satisfies /((?/?-) = p{h) ■ f{g) for all g & G and all h & H, the function 
if, f) '■ 9 ' — ^ {f{9)i f{9)) descends to the coset space G/H. One defines m— Ind^ p as the 
unitary representation of G where: 

• the underlying space consists of measurable functions / : G — > "H such that 
f{gh) = p{h) ■ f{g) for all g G G and all h G H and such that jQ^^jif, f) dp < oo; 

• the inner product is defined by 



(/i,/2)^ / {fij2)dp; 
Jg/h 

the G-action is given by left translation, as before. 
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4.4. Jacquet functors. If G is an ^-group and (vr, V) is a smooth representation of G, 
we denote by Jg(^) the quotient of V by the subspace spanned by all elements of the 
form 7c{g) ■ v — v, where g & G and v &V . By "abstract nonsense," Jq is a right exact 
functor from 'R-{G) to the category of C-vector spaces. The following observation goes 
back to the works of Jacquet and Langlands. 

Lemma 4.5 (see Prop. 2.35(b) in |[BZ76|| ). If G is an ic-group, the functor Jq is exact. 

4.5. Representations of £c-groups. Lemma |4.5| has important consequences for the 
representation theory of £c-groups. Special cases of the following result have been used in 
the literature, but we include a proof for convenience. 

Proposition 4.6. Let G be an ic-group. For any n G TZiG), the smooth dual t^^ is an 
injective object in the category 1Z{G). 

Proof. For any p G Ti{G) we have a chain of natural isomorphisms 

Hom7^(G)(p,7r'^) ^Hom7^(G)(p ®c tt, C) = Homc(JG(p (8)c7r),C), 
and by Lemma [4.5| , the right hand side is a composition of three exact functors in p. □ 
Corollary 4.7. // G is an l^-Qfoup and tt G T^iG) is admissible, then tt is injective in 

n{G). 

Proof. Combine Lemma |4.3| with Proposition [4.6|. □ 



Corollary 4.8. If G is an i^-group such that every smooth irreducible representation of G 
is admissible, then every nonzero smooth representation of G has an irreducible quotient. 

Proof. By Zorn's lemma, if p G 7?.(G) is finitely generated and p 7^ 0, then p has an 
irreducible quotient (no assumptions on G are required here). Hence if p G TiiG) is 
arbitrary with p 7^ 0, then p has an irreducible suftquotient. But in our situation, all 
smooth irreducible representations of G are injective by Corollary ^.7| , so we see that p 
has an irreducible quotient. □ 

4.6. The Pontryagin dual of an £c-gi"oup. Let U be an £c-group. If U is merely 
viewed as a topological group, one knows how to define its Pontryagin dual ?7*; it is a 
commutative topological group which is canonically identified with the Pontryagin dual 
of the abelianization f/"'' = f//(f/, U) (here (?7, U) is the closure of the group-theoretic 
commutator subgroup of U). 

However, for £c-groups the Pontryagin dual construction has some special properties: 

Lemma 4.9. // U is an ic-group, then every continuous homomorphism x '■ U — > 
takes values in the unit circle C and has open kernel. The Pontryagin dual U* , 
with its standard compact-open topology, is also an ic-group. 

Because of this lemma, in what follows, if U is an ic-gronp we will think of elements of 
the Pontryagin dual U* as homomorphisms x '■ U — > whose kernel is open in U, and 
we will refer to them as smooth homomorphisms. 
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Proof, li X '■ U — > is a continuous homomorphism, then x{U) is equal to the union 
of its compact subgroups, whence x{U) C 5*^. Moreover, x has open kernel since a suffi- 
ciently small open neighborhood of 1 G contains no subgroups of other than {1}. 
For the last statement we may assume, after replacing U with U"'^, that U is commutative. 
Given any compact open subgroup K G U, let K-^ denote its annihilator in U*. Then 
K-^ is a compact open subgroup of U* (it can be identified with the Pontryagin dual of 
the discrete quotient U/K). Subgroups of the form K-^ form a basis of neighborhoods 
of 1 G f/* (here the assumption that U is a filtered union of its compact open subgroups 
becomes crucial), and they also exhaust all of U* as K gets smaller and smaller, by the 
previous remarks. This shows that U* is an £c-group. □ 



4.7. Summary of some results of ||Ro76|| . We conclude this section by stating some 
of the results appearing in ||Ro76|| that are used in §^ Until the end of the section we fix 



a second countable £-group G and a normal closed subgroup U <Z G that is an fc-group. 
The action of G on f/ by conjugation induces an action of G on U* by topological group 
automorphisms. 

If (p, W) is a smooth representation of U and x • U — > is a smooth homomorphism, 
then, following Rodier, we write W{x) or p(x) for Ju{.P ®c more concretely, p(x) = 
Wix) is the quotient of W by the subspace spanned by all elements of the form p{u) ■ w — 
x{u) ■ w, where u E U and w G W. If S" C t/* is a subset, we say that (p, W) has spectral 
support contained in S provided the kernel of the natural map 

w^l[w{x) 

is injective. If this holds, then, in particular, p{U) is commutative. 



Remark 4.10. Rodier assumes in ||Ro76|| that the subgroup U itself is abelian. However, 



some of his theorems can be extended to the case where U is not necessarily commutative 
simply by replacing G with G/{U,U) and U with U/{U,U). As this generalization is 
important for the applications we have in mind, we will use it to formulate the theorems 
below. 

Note that if (vr, V) is a smooth representation of G and x ^ U*, then V{x) inherits a 
natural action of the stabilizer Zg{x) of x G. 

Theorem 4.11. Let x ^ U* be such that the orbit G ■ x ^s locally closed in U* . The 
functor 7^ I — > 7f(x) ^-5 o,n equivalence between the category of smooth representations of G 
whose restriction to U has spectral support contained in G ■ x, o,nd the category of smooth 
representations of Zg{x) on which U acts via the scalar x- ^ quasi-inverse functor is 
given by c-Indf^(^). 

This reduces at once to the case where U is abelian, which follows from [ Ho 76 , Thm. 3, 
p. 186] and the remark on pp. 187-188 of op. cit. 
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Theorem 4.12. Let {tt,V) G TiiG), and let x ^ U* be such that its orbit G ■ x is 
closed in U* and 7r|^ has spectral support contained in G ■ x- U'^ix) "^^ admissible as a 
representation of Zcix); then vr is admissible as a representation of G. 



This reduces at once to the case where U is abehan, which is [ [K.o76| , Thm. 4, p. 189]. 

5. Proof of Gutkin's conjecture 



In this section we complete the proofs of Theorems |1.1| and [L.3| . The case where F is 
either R or C was covered in § ^.2| , and the case where F is finite was covered in §2.4 On 
the other hand, the statement of Theorem |1.3| formally makes sense in the case where F 
is finite, provided we equip all the groups that appear in it with the discrete topology[]. 
Since the only property of F that plays a role in the proof presented below is the fact that 
F is a locally compact totally disconnected self-dual topological field, we do not exclude 
the case where F is finite for clarity. 

5.1. Setup. We fix a (topological) field F that is either finite and discrete, or local and 
nonarchimedean of arbitrary characteristic (with its standard topology). We will begin 
by proving Theorem |1.3| , and then indicate the (minor) changes and additions needed to 



adapt our argument to Theorem 1.1 



Let A be a finite dimensional associative nilpotent algebra over F, and let vr : 1 + A — > 
GL{y ) be a smooth irreducible representation oi 1 + A. If dime K = 1, the statement 
of Theorem |1.3| becomes vacuous^, so we may assume that dime V > 1. Our first goal is 



to realize tt via induction with compact supports from a subgroup of 1 + A of the form 
1 + -B, where 5 C A is an F-subalgebra of codimension 1. 

5.2. Key construction. Choose the smallest integer m > 2 such that the restriction of 
TT to 1 + A™ acts on V by scalars, and let C : 1 + ^™ — ^ denote the corresponding 
smooth homomorphism. Note that C, must be invariant under the conjugation action of 
1 + A. In particular. Corollary p.3| yields a pairing 

: (1 + {A/A^)) X (1 + (A^-V^™)) 

induced by the map 

(1 + A) X (1 + A"-i) ^ c^ {g, h) ^ cighg-'h-'). 

Note that is not identically 1, since otherwise 7r(l + A"^^^) would consist of scalar 
operators, which would contradict the minimality requirement in the choice of m. 



'^In this setting the statements of Theorems and |l.3| become essentially equivalent, in particular 
because for a finite discrete group every representation is smooth, and every irreducible representation is 
finite dimensional (hence admissible) and unitarizable by a standard averaging argument. 

^The unitarizability of tt is equivalent to the statement that a smooth homomorphism 1 + A — 
takes values inside the unit circle in , which follows from the fact that 1 + ^ is an i^c-group (cf. Lemma 



4.9) 
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Note that the groups 1 + (A/A^) and 1 + {A'^~^/A"^) can be canonically identified 
with the additive groups of the F- vector spaces A/A"^ and A"^~^/A'^. Therefore the 
Pontryagin dual of 1 + = also has a canonical F-vector space 

structure: given A G -F and a smooth homomorphism / : A'^~^/A"^ — > C^, we define 
A ■ / : A'^-VA™ — > by (A ■ = /(A • x). Corollary ^b) means that the pairing 
induces an F-linear map 

(The right hand side can be thought of either as the Pontryagin dual or as the F-vector 
space dual of A^~'^ /A^] the two can be identified because F is a self-dual field.) 

We see that the linear map is not identically zero, whence there exists a 1-dimensional 
subspace L C A^~^ /A^ such that the composition 

(5.1) A/A^ {A'''-^/A'^y L* 

is surjective, where the second map is given by restriction. 

We let Ai G A he the preimage of the kernel of the composition (|5.1|) , and we let 
U C A^~^ be the preimage of L. Note that Ai and U are two-sided ideals (hence also 
F-subalgebras) of A. 

Lemma 5.1. We have U C Ai; equivalently, ( annihilates the commutator {1 + U,1 + U) . 

Proof. The assertion is vacuous if m > 3, so assume that m = 2. We need to check that 
the commutator pairing : (l + {A/A"^)) x (l + {A/A"^)) — is identically 1 on 
1 + L. Using the fact that dimi^L = 1, we see that there exists a & U such that every 
element of L is the image of A ■ a for some A e F. But if Ai, A2 G F, then Ai • a and A2 ■ a 
commute in A, whence C(^{1 + Aia, 1 + X2a) = 1. This yields the lemma. □ 

5.3. Key auxiliary result. The next observation is key for applying the theorems of 
| Ro76|| in our situation. 

Lemma 5.2. Let us keep all the notation of §5. 4 

(a) There exists a smooth homomorphism x : 1 + — > such that x\l_^_J^^m= C- 

(b) Any two such homomorphisms are (1 + A) -conjugate. 

(c) The stabilizer of any such x m 1 + A is equal to 1 + Ai. 

Proof, (a) By Lemma |5.1| , the restriction of vr to 1 + f/ has a 1-dimensional su6quotient. 
By Proposition [4.6| , every smooth 1-dimensional representation of 1 + ?7 is injective as an 
object of Tl{l + U). Hence Trj^^^^ has a 1-dimensional quotient; say it is given by a smooth 
homomorphism x : 1 + t/ — > C^. Since vr acts on 1 + A^ via the scalar ^, we must have 
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(b) Suppose Xi;X2 '■ I + U — > are smooth homomorphisms with XiL , 4™= C 



X2 



1+A" 

1+A™' "^^^^ Xi^ ■ X2 factors through (1 + U)/{1 + A^) = 1 + L. By our choice of L, 
there exists x G A with $^(a;) |^= Xi^ ' X2, where x is the image of x in A/A^. This means 
that 

+ y)-' ■ X2(l + y)=C{{l + x){l + y){l + x)-\l + y)-') 

for all y G U. Multiplying both sides by + y) and recalling that ( = we find 

that 

X2(l + y) = Xi ((1 + + + a;)-^) 
for all y & U, proving (b). 

(c) A calculation similar to the one we just used shows that if x • 1 + — is a 
smooth homomorphism satisfying x|i_,_^m= C5 then an element 1 + x G 1 + A stabilizes x 
if and only if ^((1 + x)(l + y){l + + y)^^) = 1 for all y eU . This is equivalent to 

X G by the construction of Ai. □ 



5.4. Proof of Theorem |1.3| . We remain in the setup of § p.2| . By induction on dimj^A, 



we may assume that all the assertions of Theorem |1.3| hold for any smooth irreducible 
representation of 1 + Ai. In particular, by Corollary [4.8| , the restriction 7r|_|^_|_^ has an 
irreducible quotient, say p. By construction, p(l + U) commutes with p(l + Ai), and 
hence, by Schur's lemma, the restriction of p to 1 + f/ is scalar, say, given by a smooth 
homomorphism x : 1 + f/ — )■ C ^ . 

Write G = 1 + A and note that by Lemma |5.2| (b), the orbit G ■ x is closed in the 
Pontryagin dual (1 + ?7)*, while by Lemma pl2|(c), the stabilizer Zcix) equals 1 + Ai. 

Since p is irreducible, it is admissible by the induction hypothesis. Hence so is the 
smooth dual p"^ (cf. Lemma |4.3| ). Note that 1 + U acts on p^ via the scalar x~^ cind 
Zg{x^^) = Zg{x) = 1 + Ai. Hence by Theorems [4.11| and [4.12| , the representation 



c— Ind^^^(p^) of 1 + y4 is irreducible and admissible. By Lemma O and Remark O, we 
have 

Indi:lp-Ind}+l((pV)V) ^ {c-lndlXlip-))\ 
and by Lemma ^l3| , the latter representation is admissible and irreducible. Hence Ind}^^^ p 



is admissible and irreducible; in particular, the natural map c — Ind}^^^ p — > lnd\X^_^ p 
must be an isomorphism. On the other hand, the natural map vr — > Ind}^^^ p coming 
from Frobenius reciprocity must also be an isomorphism; in particular, vr is admissible. 

Next, by the induction hypothesis, the representation p admits a (1 + y4i)-invariant 
positive definite Hermitian inner product. Using a translation-invariant measure on (1 + 
A)/{1 + Ai) and imitating the construction recalled in § f4.3.3| above, we can equip tt = 



c— Ind}^^^ p with a (1 + 74)-invariant positive definite Hermitian inner product. 
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Finally, using an obvious transitivity property of the functors Ind and c— Ind and the 



induction hypothesis, we conclude that all the assertions of Theorem 1.3 hold for the 



representation vr of 1 + A. This completes the proof of Theorem 1.3. 



5.5. Proof of Theorem 1.1. Let us end by explaining how the argument presented above 



needs to be modified in order to yield the assertion of Theorem |1.1| . We begin by following 



the constructions of §^]2| almost verbatim (replacing V with "H); everything there remains 
valid in the case where ir : 1 + A — > U {l-L) is a unitary irreducible representation. In order 
to complete the induction step we must show that there exists a unitary representation p 
of 1 + Ai such that vr = m — Ind}!|!^^ p. 

To this end, we will replace references to results of |[Ro76 | with the more classical 



"Mackey machine;" we refer the reader to |Po95| , Chapter 6] for a more modern exposition. 



The restriction of vr to 1 + is a unitary (not necessarily irreducible) representation of 
1 + U , which factors through the abelianization (1 + U)""^ by Lemma |5]^. Therefore vr can 
be decomposed as a direct integral of 1-dimensional unitary representations of 1 + [/, and 
this decomposition is determined by an "H-projection-valued measure P on (1 + U)* . It 
is easy to see that in the language of |[Fo95| , §6.4], the triple (vr, (1 + f/)*, P) is a "system 



of imprimitivity" on 1 + A. Moreover, since vr acts on 1 + A™ via the character ^, we 
see that P must be supported on the subset S' C (1 + U)* consisting of all x such that 
x|i_,_^m= C- By Lemma pl2|(b), S* is a single (1 + 74)-orbit. Thus (vr, 5, P) is a "transitive 
system of imprimitivity" {op. cit., §6.5). 

Finally, Theorem 6.31 in op. cit. implies that if x ^ S, then vr can be obtained by 
unitary induction from a unitary representation of Zi^a{x) = 1 + (cf. Lemma |5^(c)). 



Remark 5.3. The proof we presented here only relies on the fact that F is self-dual and 
not on the fact that it is totally disconnected. Thus we do obtain a uniform proof of 
Theorem |L1| that is valid for all self-dual locally compact topological fields at once, as 
promised. 



5.6. Final remarks. Under the hypotheses of Theorem 4.12 , Rodier proved in | Ro76| , 



Thm. 5, p. 190] that if p is a unitary irreducible representation of Zg{x) ou which U acts 
via X, then 

(As before, the reduction to the case where U is abelian, which is treated in loc. cit., is 
immediate.) 



Using this result and analyzing the arguments of §§ p.4| - |5l5| above, we see that they 
imply 

Proposition 5.4. Let F be a local nonarchimedean field, let A be a finite dimensional 
associative nilpotent algebra over F , and let : 1 + A — )■ U{l-C) be a unitary irreducible 
representation. Then the smooth part tt^"^ is irreducible as a representation of 1 + A {in 
the algebraic sense), and vr {equivalently, vr'"") is admissible. 
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It is not known to us whether the same result holds for more general ^-groups of the 
form G{F), where F = ¥g{{t)) and G is a unipotent algebraic group over F. 

If F is an infinite countable field (such as Q), we can equip F with the discrete topology, 
so that it becomes a locally compact second countable topological field. Even though such 
an F is not self-dual, the statements of Theorems [TTT] and |T]B| make sense in this setting 
as well. Justin Conrad asked whether their conclusions still hold. The answer is unknown 
to us. (Note, however, that they do hold when A is commutative, since Schur's lemma 
can be applied in this case.) 
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